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We introduce ways to measure information storage in quantum systems, using a recently intro- 
duced computation-theoretic model that accounts for measurement effects. The first, the quantum 
excess entropy, quantifies the shared information between a quantum process's past and its future. 
The second, the quantum transient information, determines the difficulty with which an observer 
comes to know the internal state of a quantum process through measurements. We contrast these 
with von Neumann entropy and quantum entropy rate and provide a closed-form expression for the 
latter for the class of deterministic quantum processes. 
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Poincare discovered that classical mechanical systems 
can appear to be random Kolmogorov, adapting 

Shannon's theory of communication [2], showed that 
their degree of randomness can be measured as a rate 
of information production H]. Shannon, in fact, adopted 
the word "entropy" to describe information transmitted 
through a communication channel based on a suggestion 
by von Neumann, who had recently used entropy to de- 
scribe the distribution of states in quantum systems 0, 
Ch. 5]. Information has a long history in quantifying 
degrees of disorder in both classical and quantum me- 
chanical systems. 

In a seemingly unrelated effort, Feynman proposed to 
develop quantum computers || with the goal of (greatly) 
accelerating simulation of quantum systems. Their po- 
tential power, though, was brought to the fore most re- 
cently by the discovery of algorithms that would run 
markedly faster on quantum computers than on classi- 
cal computers. Experimental efforts to find a suitable 
physical substrate for a quantum computer have been 
well underway for almost a decade now Q. 

In parallel, the study of the quantum behavior of clas- 
sically chaotic systems gained much interest Q , most re- 
cently including the role of measurement. It turns out 
that measurement interaction leads to genuinely chaotic 
behavior in quantum systems, even far from the semi- 
classical limit [8(. 

How are computing, information creation, and dynam- 
ics related? A contemporary view of these three historical 
threads is that they are not so disparate. We show here 
that a synthesis leads to methods to analyze how quan- 
tum processes store and manipulate information — what 
we refer to as intrinsic quantum computation. 

Computation-theoretic comparisons of classical 
(stochastic) and measured quantum systems showed 
that a quantum system's behavior depends sensitively on 
how it is measured. The differences were summarized in 
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a hierarchy of computational model classes for quantum 
processes [9!]. Here we adopt an information-theoretic 
approach that, on the one hand, is more quantitative 
than and, on the other, is complementary to the struc- 
tural view emphasized by the computation-theoretic 
analysis. To start, recall the finite- state quantum 
generators defined there. They consist of a finite set 
of internal states Q — {q t : i — 0, . . . , \Q\ — 1}. The 
state vector over the internal states is an element of a 
| Q | -dimensional Hilbert space: (yb\ G TL. At each time 
step a quantum generator outputs a symbol s € A and 
updates its state vector. 

The temporal dynamics is governed by a set of | tri- 
dimensional transition matrices {T(s) = U •P(s), s G A}, 
whose components are elements of the complex unit disk 
and where each is a product of a unitary matrix U and 
a projection operator P(s). U governs the evolution of 
the state vector. P = {P(s) : s G .4} is a set of pro- 
jection operators that determine how the state vector is 
measured. We base our analysis on the class of projective 
measurements, applicable to closed quantum systems fl8j. 
In the measurement setting used here the output symbol 
s is identified with the measurement outcome and labels 
the system's eigenvalues. We represent the event of no 
measurement with the symbol A; P(X) can be thought of 
as the identity matrix. Thus, starting with state vector 
(ipo\, a single time-step yields (ip(s)\ = {ipo\U • P{s)- 

To describe how an observer chooses to measure a 
quantum system we introduce the notion of a measure- 
ment protocol. A measurement act — applying P(m), m G 
A (J A — returns a value s G A or nothing (to = A) . A 
measurement protocol, then, is a choice of a sequence of 
measurement acts m t G .41JA. If an observer asks if 
the measurement outcomes S1S2S3 occur, the answer de- 
pends on the measurement protocol, since the observer 
could choose protocol S1AAS2AS3, S1S2S3, or others. Fix- 
ing a measurement protocol, then, the state vector after 
observing the measurement series m N = mi...rajv is 
(ip(m N )\ = (ip \U ■ P{mi) ■ U ■ P(m 2 ) •■■U ■ P(m N ). 

A quantum process is the joint distribution 
Pr(. . . S—2S-1S0S1 . . .) over the infinite chain of 
measurement random variables St- Defined in this way, 
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it is the quantum analog of what Shannon referred to 
as an information source [nj. Starting a generator in 
{-00 1 the probability of output s is given by the state 
vector without renormalization: Pr(s) = UVK 8 )!! ■ By 
extension, the word distribution, the probability of 
outcomes s L from a sequence of L measurements, is 
Pr(s L ) = ||V(s L )|| 2 . 

We can use the observed behavior, as reflected in the 
word distribution, to come to a number of conclusions 
about how a quantum process generates randomness and 
stores and transforms historical information. The Shan- 
non entropy of length-!/ sequences is defined 

H(L) = - Pr(.s i )log 2 Pr( S i ) . (1) 

s L eA L 

It measures the average surprise in observing the "event" 
s L . Ref. [ll[ showed that a stochastic process's informa- 
tional properties can be derived systematically by taking 
derivatives and then integrals of H(L), as a function of 
L. For example, the source entropy rate is the rate of 
increase with respect to L of the Shannon entropy in the 
large- L limit: 

h„ = lim [H(L) - H(L - 1)] , (2) 

L — >OG 

where the units are bits/measurement [Io| . The entropy 
rate quantifies the irreducible randomness in mea- 
surement sequences produced by a process: the random- 
ness that remains after the correlations and structures 
in longer and longer sequences are taken into account. 
The latter, in turn, are measured by two complementary 

quantities. The amount I(S', S) of mutual information 

shared between a process's past S and its future S is 
given by the excess entropy E . It is the subextensive 
part of H(L): 

E = lim [H(L) - h^L] . (3) 

L — >oo 

Note that the units here are bits. Ref. [HI also showed 
that the amount of information an observer must extract 
from measurements in order to know the internal state is 
given by the transient information: 

oo 

T = J2[^ + h„L-H(L)] , (4) 

L=0 

where the units are bits x measurements. 

If one can determine the word distribution Pr(s L ), 
then, in principle at least, one can calculate a quantum 
process's informational properties: h^, E, and T. Fortu- 
nately, there are several classes of quantum process for 
which one can give closed-form expressions. For example, 
we will provide a way of computing exactly, using the 
finite-state machine representation of a quantum process, 
similar to what is known for classical stochastic processes 
We then give examples of various quantum pro- 
cesses at the end, measuring their intrinsic computation. 



In quantum theory one distinguishes between complete 
and incomplete measurements. A complete measurement 
projects onto a one-dimensional subspace of TL. A com- 
plete quantum generator (CQG) is simply a quantum 
generator observed with complete measurements. 

Another, as it turns out, more general class of quantum 
processes are those that can be described by a determin- 
istic quantum generator (DQG), where each matrix T(s) 
has at most one nonzero entry per row. The importance 
of determinism comes from the fact that it guarantees 
that an internal-state sequence qtqt+iqt+2 ... is in 1-to-l 
correspondence with a measurement sequence StSt+iSt+2- 

m 

It simplifies matters if the word distribution is inde- 
pendent of the initial state vector (-00 1 • This is achieved 
by switching to the density matrix formalism [9J . A sta- 
tionary state distribution p s can then be found for DQGs 
and Pr(s L ) = Tr [T* (s L )p s T(s L )] is start-state indepen- 
dent. 

We showed that every DQG has an equivalent de- 
terministic classical generator that produces the same 
stochastic process [9]. Specifically, given a DQG M — 
{[/, P{s)}, the equivalent classical generator M' = 
{T, -P(s)} has unistochastic transition matrix = 
\Uij\ 2 . 

As a consequence, when a quantum process can be 
represented by a complete or a deterministic generator, 
closed-form expressions exist for several of the informa- 
tion quantities. For example, adapting Ref. [l2j to DQGs 
we obtain the quantum entropy rate: 

\Q\-1\Q\-1 

h^-iQr 1 E i^i 2l °g 2 i^-i 2 , (5) 

using the fact that p\; L — \Q\~ Y for DQGs. This should 
be compared to the entropy rates for nondetcrministic 
classical and quantum processes which, in general, have 
no closed-form expression. For DQGs we introduce the 
internal- state quantum entropy: 

101— i 

S g = - J2 fit lo §2 Pii . (6) 

i=0 

which measures the average uncertainty in knowing the 
internal state. Again, pa = \Q\ _1 for DQGs allows us to 
simplify: S q = log 2 \Q\. 

S q , as defined here, is nothing other than the von Neu- 
mann entropy S(p) of the density matrix p [l3j . Note, 
that our use of the density matrix is as a time average, not 
an ensemble average. This should be further compared 
to the von Neumann entropy S{®^Zq Pi) over a sequence 
of density matrices produced by a stationary quantum 
source [141]. Using this, a density-matrix quantum en- 
tropy rate can be defined as the limit of S^fs^p^/L for 
large L. Note that these alternative definitions of entropy 
and entropy rate suffer from two problems. First, they 
refer to internal variables that are not directly measur- 
able. Second, they do not take the effects of measurement 
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FIG. 1: Iterated beam splitter: Thick solid lines are mirrors. 
Photon detectors, marked as D, are placed in upper and lower 
photon paths (solid gray lines). 

into account. Importantly, E, and T do not suffer 
from these problems. Let's explore their consequences 
for characterizing intrinsic computation in several simple 
quantum dynamical systems. (An exhaustive analysis of 
all (deterministic and non-deterministic) few-qubit quan- 
tum processes will appear elsewhere.) 

The iterated beam-splitter (Fig.[T]) is a quantum system 
that, despite its simplicity, makes a direct connection to 
familiar experiments. Photons are sent through a beam- 
splitter, producing two possible paths, which are redi- 
rected by mirrors and recombined at the beam-splitter 
after passing around the feedback loop determined by 
the mirrors. Nondestructive detectors are located along 
the upper and lower paths. 

The iterated beam splitter is a quantum dynamical 
system with a two-dimensional state space (which path 
is taken around the loop) with eigenstates "above" (4>a\ 
and "below" {4>b\- Its dynamics are given by a unitary 
operator for the beam-splitter, the Hadamard matrix 
Uh = ;4g (1 -1)) an d measurement operators represent- 
ing the detectors: P(0) = |0) (0| andP(l) = |1) (1|, in the 
experiment's eigenbasis. Measurement symbol stands 
for "above" and symbol 1 stands for "below" . 

The detectors after the first beam splitter detect the 
photon in the upper or lower path with equal probability. 
Once the photon is measured, though, it is in that detec- 
tor's path with probability 1. And so it enters the beam 
splitter again in the same state as when it first entered. 
Thus, the measurement outcome after the second beam 
splitter will have the same uncertainty as after the first: 
the detectors still report "above" or "below" with equal 
probability. The resulting sequence of detector outcomes 
after many circuits of the feedback loop is simply a ran- 
dom sequence. Call this measurement protocol I. 

Now alter the experiment slightly by activating the de- 
tectors only after every other circuit of the feedback loop. 
In this set-up, call it protocol II, the photon enters the 
first beam splitter, passes an inactive detector and in- 
terferes with itself when it returns to the beam splitter. 
This, as we will confirm, leads to destructive interfer- 
ence of one path after the beam splitter. The photon is 
thus in the same path after the second visit to the beam 
splitter as it was on the first. The now-active detector 



therefore reports with probability 1 that the photon is in 
the upper path, if the photon was initially in the upper 
path. If it was initially in the lower path, then the detec- 
tor reports that it is in the upper path with probability 
0. The resulting sequence of path detections is a very 
predictable sequence, compared to the random sequence 
from protocol I. Note that both protocols are complete 
measurements . 

We now construct a complete quantum generator for 
the iterated-beam splitter. The output alphabet con- 
sists of two symbols denoting detection "above" or "be- 
low": A ~ {0, 1}. There are two internal states "above" 
and "below" , each associated with one of the two system 
eigenstates: Q — {A, B}. The transition matrices are 
T(0) = U H P{0) and T(l) = U H P(1). We assume that 
the quantum process has been operating for some time 
and so take p s = J2ieQ I&) 

One can readily verify that this representation of the 
iterated beam splitter is a DQG. And so we can deter- 
mine its classical equivalent generator has transition ma- 
trices T(0) = |(18) and T(l) = \ ( g \ ). The sequences 
it generates for protocol I are described by the uniform 
distribution at all lengths: Pr(s L ) = 2~ L . 

Note, however, that the probability distribution of the 
sequences for the classical generator under protocol II 
is still the uniform distribution for all lengths L. This 
could not be more different from the behavior of the 
(quantum) iterated beam splitter under protocol II. The 
classical generator is simply unable to capture the in- 
terference effects present in this case. A second clas- 
sical generator must be constructed from the quantum 
generator's transition matrices for protocol II. One finds 
T(0) = 3 Co 0) and T (!) = Hoi)- Starting the pho- 
ton in the upper path again, for protocol II one finds 
Pr(00 . . .) = Pr(ll . . .) = 1/2 and all other words have 
zero probability. 

Table Q] gives the informational quantities for the it- 
erated beam splitter under the protocols. Under proto- 
col I it is maximally random (h^ = 1), as expected. It 
also, according to E = 0, does not store any historical 
information and the observer comes to know this imme- 
diately (T = 0). In stark contrast, under protocol II, the 
iterated beam splitter is quite predictable (h^ = 0) and 
stores one bit of information (E = 1) — whether the mea- 
surement sequence is 000 ... or 111 . . .. Learning which 
requires extracting one bit (T = 1) of information from 
the measurements. 

Note that the internal-state (von Neumann) entropy 
S q = 1 under both protocols: there are two equally likely 
states in both cases. It simply reflects the single qubit 
in the iterated beam splitter, not whether that qubit is 
useful in supporting intrinsic computation. 

Now consider a second, more complex example: A 
spin-1 particle subject to a magnetic field that rotates 
its spin. The state evolution can be described by the 

/ 1/V2 1/V2 \ 
unitary matrix U = I -1 , which is a rota- 

V-1/V2 1/V2 / 
tion in R 3 around the y-axis by angle ^ followed by a 
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Quantum 


Iterated Beam 


Spin-1 


Dynamical System 


Splitter 


Particle 


Protocol 


I 


II 


I 


II 


[bits/measurement] 


1 





0.666 


0.666 


S q [bits] 
E [bits] 


1 


1 


1.585 


1.585 





1 


0.252 


0.902 


T [bitsY. measurement] 





1 


0.252 


3.03 



TABLE I: Information storage and generation for example 
quantum processes: entropy rate internal-state entropy 
S q , excess entropy E, and transient information T. 

rotation around the x-axis by J. 

Using a suitable representation of the spin operators 

Ji [ll p.199], such as: J x = (jj_°J), Jy = (°Jg)> 

and J z = | -ioo ] , the relation P.* = 1 — J, 2 defines a 
V o o o J 

one-to-one correspondence between the projector Pj and 
the square of the spin component along the i-axis. The 
resulting measurement poses the yes-no question, Is the 
square of the spin component along the z-axis zero? 

Define two protocols, this time differing in the pro- 
jection operators. First, consider measuring J 2 ; call 
this protocol I. Then U and the projection operators 
P(0) = 1 100) (100| + 001) (001 1 and P(l) = |010) (010| 
define a quantum generator. 

The stochastic language produced by this process is the 
so-called Golden-Mean Process language [IJj. It is de- 
fined by the set of irreducible forbidden words J- — {00}. 
That is, all measurement sequences occur, except for 
those with consecutive 0s. For the spin-1 particle this 
means that the spin component along the y-axis never 
equals twice in a row. We call this short-range correla- 
tion since there is a correlation between a measurement 
outcome at time t and the immediately preceding one at 
time t — 1. If the outcome is 0, the next outcome will be 
1 with certainty. If the outcome is 1, the next measure- 
ment is maximally uncertain: outcomes and 1 occur 
with equal probability. 

Second, consider measuring the observable J 2 ; call this 
protocol II. Then U and P(0) = |100) (100| and P(l) = 
|010) (010| + |001) (001 define a quantum finite-state gen- 
erator. The stochastic language generated is the Even 
Process language (llj |. It is characterized by an infinite 
set of irreducible forbidden words T — {01 _1 0}, fc = 
1,2,3, .... That is, if the spin component equals along 
the x-axis, it will be zero an arbitrary large, even number 
of consecutive measurements before being observed to be 
nonzero. 

Table Q] gives the intrinsic-computation analysis of the 
spin-1 system. Comparing it to the iterated beam split- 
ter, it's clear that the spin-1 system is richer — a process 
that does not neatly fall into one or the other extreme 
of exactly predictable and utterly unpredictable. In fact, 
under protocols I and II it appears equally unpredictable: 
hp « 0.333. As before the von Neumann entropy is also 
the same under both protocols. The amount of infor- 



mation that the spin-1 system communicates from the 
past to the future is nonzero, with the amount under 
protocol I (E « 0.252) being less than under protocol II 
(E m 0.902). These accord with our observation that in 
the latter case there is a kind of infinite-range tempo- 
ral correlation. Not too much information (T 0.252) 
must be extracted by the observer under protocol I in 
order to see the relatively little memory stored in this 
process. Interestingly, however, under protocol II this is 
markedly larger (T w 3.03), indicating again that the 
observer must extract more information to see just how 
this process is monitoring "evenness" . 

We close by looking at a repeatedly measured quan- 
tum system in the context of recent developments in 
quantum computation. Quantum control theory — a 
paradigm of repeated classical-state measurement and 
feedback control — has only recently been implemented as 
a means to drive quantum systems toward a desired state 
or dynamic [l6j . Current implementations are finite- 
dimensional and aim at the control of a known quantum 
state. Therefore, our formalism can be used to character- 
ize the intrinsic computation of these quantum systems. 
In fact, it can be used on any quantum system observed 
over time, whether its exact state is known or not. If it is 
known and the applied measurement protocol generates 
a deterministic quantum process the above measures of 
intrinsic computation can be calculated exactly using its 
quantum generator representation. Generally, though, 
the intrinsic quantum computation of an unknown quan- 
tum state can be measured experimentally by recording 
a time series of measurement outcomes and computing 
the probability distribution. In fact, from the probabil- 
ity distribution of a discrete time series of measurements 
one can compute the intrinsic computation of both open 
and closed quantum systems. 

We introduced several new information-theoretic quan- 
tities that reflect a quantum process's intrinsic computa- 
tion: its information production rate, how much mem- 
ory it apparently stores in generating information, and 
how hard it is for an observer to synchronize. We dis- 
cussed how several of these informational quantities are 
related to existing notions of entropy in quantum theory. 
The contrast allowed us to demonstrate how much more 
they tell one about the intrinsic computation supported 
by quantum processes and to highlight the crucial role 
of measurement. For example, simply knowing that a 
quantum process is built out of some number of qubits 
only gives an upper bound on the possible information 
processing. It does not reflect how the quantum system 
actually uses the qubits to process information nor how 
much of its information processing can be observed. For 
these, one needs the quantum E, and T. 

UCD and the Santa Fe Institute supported this work 
via the Network Dynamics Program funded by Intel Cor- 
poration. The Wenner-Gren Foundations, Stockholm, 
Sweden, provided KWs postdoctoral fellowship. 
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